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(54) Distributed digital image processing system 

(57) A method and apparatus for using feedback 
and feedforward in generating predictable reproducible 
and pleasing images in a distributed digital image 
processing system (1000) monitors presentation 
images and provides feedback to a customer that 
assembled the original image. The originating customer 
can view the image as it appears on a remote output 
device (600-800) and/or adjust the image so that the 
presentation image will match the image appearing on 
the image originating device (100). The system can also 
automatically adjust the digital images as they are proc- 
essed by the system to insure that a remotely outputted 
presentation image matches the original image on the 
image originating device or on a local output device 
proximal with the image originating device. 
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Description 

[0001] This invention relates to the generation of 
presentation images in a distributed digital image 
processing system. In particular, this invention is 5 
directed to the use of feedback and feedforward in gen- 
erating predictable, reproducible and aesthetically 
pleasing images in a distributed digital image process- 
ing system. 

[0002] Distributed digital image processing systems w 
provide a method for generating an image from an 
image originating device and distributing the image to 
output devices in both proximal and remote locations. 
However, in conventional distributed digital image 
processing systems, problems arising with remote out- is 
put devices, such as unsatisfactory image and/or color 
quality, output device inoperability, and output device 
resource deficiencies, are not readily detectable or cor- 
rectable by a customer situated at the image originating 
device. For example, a customer generating an image 20 
(usually a digital image) at an image originating device 
is not immediately aware of the quality of that image as 
rendered on a remotely located display or printer. Due 
to the different configurations between various output 
devices, an image that appears pleasing at the image 25 
originating device or its associated local output device 
may not be accurately replicated by the desired remote 
output device. Such problems are quite common and 
cause significant inconvenience and dissatisfaction. 
[0003] Unsatisfactory image and/or color quality 30 
can result from various system limitations. For example, 
discrepancies can arise when an image is converted 
from red, green and blue (RGB) components to cyan, 
magenta, yellow and black (CMYK) components. The 
system is also limited by the gamut of colors that can be 35 
produced by any given output device, which is often dif- 
ferent than the gamut available on the image originating 
device. Further, the system is limited by the characteris- 
tics of each particular output device that cause it to out- 
put an unsatisfactory image. For example, the actual 40 
output colors may depend on the color of ink or toner, a 
low ink or toner state, and the like. Additionally, over 
time, the actual output of the output device may drift, 
i.e., deviate from predetermined optimum standards, 
due to various factors. These factors include environ- 45 
mental conditions, such as temperature, relative humid- 
ity, and the like, use patterns, the type of media used 
(such as different ^per types, transparencies, and the 
like), variations irv media, variations from original mod- 
els used in initializing the hard copy output device, gen- so 
eral wear, and the like. Thus, even though the output 
device may be capable of producing a presentation 
image that matches the original image, the desired 
image may still not be achieved due to the current status 
of the particular output device. 55 
[0004] Fig. 1 shows an example of the connectivity 
of a simplified global distributed digital image process- 
ing system. As shown in Fig. 1 , the distributed digital 
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image processing system 10 includes an image origi- 
nating device 20 having a display device (not shown), 
located, for example, in Webster. New York. A proxi- 
mally located printer 25 is connected to the image orig- 
inating device 20. The image originating device 20 is 
connected to a server, or set of connected servers, 30 
that may or may not be located proximal the image orig- 
inating device 20. Alternatively, a proximally located 
printer 26 could be connected to the image originating 
device 20 by way of the server, or set of connected serv- 
ers, 30. Three remote printers 40 are connected to the 
central server, or set of connected servers. 30, and are 
located, for example, in Chicago, Tokyo and Budapest. 
[0005] After a customer creates pleasing docu- 
ments on the image originating device 20, the customer 
prints them on the local printer 25. The documents 
printed on the local printer 25 are usually satisfactory 
because, for example, the image originating device 
and/or the display device are calibrated for the local 
printer 25. The customer may then need to print the 
documents on one or more of the remote printers 40. 
However, the actual image printed on the remote print- 
ers 40 may not appear as the customer expected. This 
may be due to. for example, poor color transformations 
between the work station, central server and remote 
printers, the requested colors being out of the gamut of 
the remote printers, the remote printers having different 
screening or halftoning, or the like. 
[0006] In general, although not shown in Fig. 1, the 
conventional distributed digital image processing sys- 
tems may include a large number of work stations 20 
connected to the server 30. Although not shown in Fig. 
1 , a distributed digital image processing system may 
include a plurality of servers connected together to 
share the workload in performing requested operations. 
Similarly, although not shown in Fig. 1 , a large number 
of output devices 40 are usually connected to the 
server, or set of connected servers, 30 and are located 
at widely distributed locations. Each of the output 
devices 40 is a physical device, or hardware, that is 
capable of rendering images of documents and/or pro- 
ducing hard copy output of the print jobs received from 
the server, or set of connected servers, 30. The output 
devices include, but are not limited to video displays, 
direct markers (i.e., direct marking devices, which 
include printers and other similar devices), and indirect 
markers (where the image is developed on an imaging 
member and subsequently transferred to an output sub- 
strate). The customers of the work station 20 include 
any end user. 

[0007] There is the need for a distributed digital 
image processing system that dynamically monitors 
each aspect of an image processing operation to 
ensure that a desired remote output device will produce 
a presentation image substantially the same as an 
image created and viewed by a customer at an image 
originating device or its proximal local output device. 
Presently, the only reliable way to monitor the presenta- 
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tion images of remote output devices is to travel to the 
location of each output device printer and observe the 
printed output or the displayed image, or to have a 
printed output delivered back to the customer at the 
image originating device. Thus, monitoring the presen- 5 
tation images output by the remotely located output 
devices is nearly impossible in a distributed digital 
image processing system, because traveling to the plu- 
rality of locations remote from the originating worksta- 
tion is impractical, and delivering a printed output from a 10 
remote location to the customer requires some delay 
time to allow for courier or postal delivery. 
[0008] This invention provides a method and appa- 
ratus for using feedback and feedforward in generating 
predictable, reproducible and pleasing images in a dis- is 
tributed digital image processing system. 
[0009] In one aspect of this invention, a method and 
apparatus using feedback and feedforward in generat- 
ing predictable, reproducible and pleasing images in a 
distributed digital image processing system monitors 20 
presentation images and provides feedback to a cus- 
tomer who assembled the original image, so as to allow 
the originating customer to view the image as it appears 
on a remote output device and/or to adjust the image so 
that the remotely outputted presentation image will 25 
match a locally outputted version of the image resident 
on the image originating device. 
[001 0] In another aspect of this invention, a method 
and apparatus using feedback and feedforward in gen- 
erating predictable, reproducible and pleasing images in 30 
a distributed digital image processing system monitors 
presentation images and provides feedback to a system 
component, so as to allow for automatic adjustment of 
various digital representations of the assembled image 
to insure that a presentation image will match the corre- 35 
sponding image assembled on an image originating 
device. 

[0011] In yet another aspect of this invention, an 
image originating device queries the remote output 
devices, via a central server or set of servers, to identify 40 
the capabilities and state of each remote output device. 
Printing application software residing on either the 
image originating device or the central server(s) adjusts 
the assembled image to create a presentation image on 
any or all of the remote output devices that matches a 45 
representation, displayed at the image originating 
device, of the image assembled at the image originating 
device in which the effects inherent in the output device 
(e.g., gamut, lighting) have been simulated. For pur- 
poses of this invention, the term "matches" means that so 
the presentation image from an output device appears 
the same, within specified standards, as the simulated 
image at the image originating device. 
[001 2] These and other features and advantages of 
this invention are described or are apparent from the fol- ss 
lowing detailed description of exemplary preferred 
embodiments. 

[0013] Exemplary preferred embodiments of this 



invention will be described in detail, with reference to 
the following drawings, wherein like numerals represent 
like elements and wherein: 

Fig. t is a simplified schematic view showing possi- 
ble connections between elements of a conven- 
tional distributed digital image processing system; 
and 

Fig. 2 is a combination flow chart and logical block 
diagram of a distributed digital image processing 
system using feedback in the generation of presen- 
tation images according to this invention. 

[0014] For a general understanding of the features 
of the present invention, reference is made to the draw- 
ings, wherein like reference numerals have been used 
throughout to identify identical or similar elements. Ini- 
tially, a system and method for using feedback and feed- 
forward in the generation of presentation images in a 
distributed digital image processing system in accord- 
ance with the present invention will be described with 
reference to Fig. 2. For purposes of this invention, a dis- 
tributed digital image processing system generally has 
at least one output device positioned in a remote loca- 
tion, i.e.. where it cannot be conveniently viewed by a 
customer located at an image originating device. 
[001 5] While the present invention will be described 
in terms of an illustrative embodiment or embodiments, 
it will be understood that the invention is adaptable to a 
variety of distributed digital image processing systems, 
such that the present invention is not necessarily limited 
to the particular embodiment or embodiments shown 
and described herein. On the contrary, the following 
description is intended to cover all alternatives, modifi- 
cations, and equivalents, as may be included within the 
spirit and scope of the invention. 
[0016] The term "image" as used in this disclosure 
refers to a graphic or plurality of graphics, compilation of 
text, a contone or halftone pictorial image, or any com- 
bination or subcombination thereof, that is capable of 
being output on a display device, a marker and the like, 
including a digital representation of such image. For 
example, an image may be a combination of graphics, 
text and pictures that is represented by as a series of 
pixel values denoting the color, intensity, etc., of the par- 
ticular pixels that make up the image. A special sub- 
class of images are those associated with complete 
documents, which are hereinafter referred to as "docu- 
ment images." Thus an image may be a document 
image assembled by a customer at the image originat- 
ing device, one or more elements of a document image, 
a "test patch" generated by printing application software 
or another type of control system, or a member of a col- 
lection of images in a database. 
[0017] The term "presentation image" as used in 
this disclosure refers to an image directly visible to 
human observers that is outputted on an output device 
(e.g., a marker or a display). A presentation image 
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encompasses a single page image and a multiple page 
image. The presentation image may include a test pat- 
tern, or test patch, that precedes the single page or mul- 
tiple page image. Depending on the size of a multiple 
page image, the presentation image may include multi- 5 
pie test patterns or patches interspersed throughout. A 
presentation image also encompasses multiple copies 
of a single page or multiple page image. The presenta- 
tion image may have a test pattern or patch that pre- 
cedes each copy, depending on the size of the 10 
presentation image. 

[001 8] Fig. 2 shows a combination logical block dia- 
gram and flow chart for a distributed digital image 
processing system 1000 according to the invention. As 
shown, the distributed digital image processing system 75 
1000 includes an image originating device 100. The 
image originating device 100 may be, but is not limited 
to, a personal computer, a personal digital assistant 
(PDA), a computer work station, a scanner, a digital 
copying device or the like. The image originating device 20 
100 is used to assemble an image. For example, the 
assembling of an image can be achieved by using the 
image originating device to prepare a script containing 
pointers (e.g., by use of a token) directed to images 
stored on data storage devices that are accessible 25 
through the distributed digital image processing system 
1 000. The assembling of an image can also be accom- 
plished, for example, by scanning an image, utilizing 
software to create an image, or loading an image stored 
on a removable medium. 30 
[001 9] In Fig. 2, arrows indicate the flow of informa- 
tion between the image originating device and the 
media on which a presentation image is ultimately out- 
put. The information flow is comprised of three funda- 
mentally different types of data streams: (1) a digital 35 
representation of the information (text, pictures, graph- 
ics, etc.), (2) a description of how this information is 
assembled (e.g., a job ticket), and (3) various calibration 
and control data describing the states of the various 
devices which might influence the presentation of the 40 
information, such as gamut information, color informa- 
tion (e.g, toner levels), media properties (e.g., humidity, 
thickness, optical properties, etc.), state properties 
(e.g., paper out, offline, power off, etc.) and the like. This 
invention primarily focuses on the digital representa- 45 
tions of images and the control data of the processing 
devices and the output devices. Information contained 
in the job ticket (the description of how the information is 
assembled) may be used to decide how to implement 
the actual adjustments. Job tickets may contain cus- so 
tomer preferences, draft as final copy, paper stock to be 
used, etc., that may assist the implementation in making 
parameter adjustments. 

[0020] The distributed digital image processing sys- 
tem 1000 also includes image processing devices 200. 55 
300, 400. 500. The image processing devices can 
include image converters, image transmitters, images 
storage devices and/or image rendering devices that 



process the assembled image for output as a presenta- 
tion image. The system 1000 may have none, one or a 
plurality of each of the above devices. For example, the 
system shown in Fig. 2 may have two image converters 
200, 400, an image transmitter and/or image storage 
device 300, and an image rendering device 500. 
[0021] The image processing devices 200-500 are 
coupled together via communication links 110, 210, 
310, 410. The links may be any type of link that permits 
the transmission of data, for example, direct serial con- 
nections, a local area network (LAN), a wide area net- 
work (WAN), a network of networks such as the Internet 
and the World Wide Web (WWW), a metropolitan area 
network (MAN), a satellite communication network, an 
infrared communication network, circuit wirings, and the 
like. Therefore, the image processing devices 200, 300. 
400, 500 may optionally reside on a single physical 
structure, for example, a central server 150 (indicated 
by the broken line in Fig. 2), or they may reside on mul- 
tiple structures situated in remote locations, as long as 
they are connected by one or more of the aforemen- 
tioned links. Further, the image rendering device 500 
often resides within the output device with which it com- 
municates. 

[0022] As shown in Fig. 2, the distributed digital 
image processing system 10CD also includes a plurality 
of output devices 600, 700, 800. Information flow paths 
510, 520, 530 represent the flow of the digital represen- 
tation of the information (text, pictures, graphics, etc.) 
and the description of how this information is to be 
assembled. Output device 600 is a video display, output 
device 700 is a direct marker and output device 800 is 
an indirect marker. Therefore, the rendering device 500 
must perform a different transformation of the digital 
image to the presentation image for each of the different 
output devices 600, 700, 800. In the event that there are 
more than three output devices, the rendering device 
500 may have to perform a different transformation for 
each output device. Alternatively, each output device 
600, 700, 800 may have its own associated rendering 
device. 

[0023] The video display 600 may be any device 
known in the art including, but not limited to a cathode 
ray tube (CRT) device, a flat panel display, a computer 
monitor and other such display devices. The direct 
marker 700 may be any marking device known in the 
art, e.g., a printer that prints an image directly from dig- 
ital form to an output media. Thus, the direct marker 700 
includes devices such as, but not limited to, ink jet print- 
ers, bubble jet printers, thermal transfer printers, dye 
sublimation printers and the like. The indirect marker 
800 may be any device known in the art that outputs an 
image on an imaging medium at an imaging station 810, 
develops the image at a developing station 820, trans- 
fers the image to an intermediate medium or an output 
medium at a transfer station 830, and finishes the image 
at a finishing station 840. 

[0024] For example, the indirect marker 800 may be 
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a lithographic printer, in which case an image is formed 
on a lithographic plate (e.g., directly by a laser) at the 
imaging station 810, the image is developed at the 
developing station 820 by inking a lithographic plate, the 
image is transferred to an intermediate blanket at the 5 
transfer station 830, and the image is transferred to an 
output medium at the finishing station 840. In the case 
of a Xerographic printer, an image is formed on a pho- 
toreceptor at the imaging station 810, the image is 
developed at the developing station 820 by supplying 1C 
toner to the photoreceptor, the image is transferred to 
an output medium at the transfer station 830, and the 
image is fused to the output medium at the finishing sta- 
tion 840. This class of marker includes those using 
transfer of the image from the imaging medium (e.g., a 15 
photoreceptor or a lithographic plate) to one or more 
intermediate media (e.g., transfer belts, intermediate 
blankets or drums) prior to its ultimate transfer to the 
output medium. For clarity, details of the multiple varia- 
tions of intermediate transfers are not shown. Similarly, 2 o 
additional finishing stations 840 may be used, for exam- 
ple, ink drying stations in lithography and paper condi- 
tioning stations in Xerography. These also are not 
shown for clarity. Thus, the indirect marker 800 includes 
devices such as, but not limited to, lithographic printers, 2 s 
xerographic printers, Sonographic printers, liquid immer- 
sion printers and the like. 

[0O25] Output device 800 is described as having a 
complex internal structure. Output devices 600 and 700 
may likewise possess their own internal complexity and 30 
corresponding internal parameters. These internal 
parameters may be, in like manner to those of output 
device 800, fed back to the processing functions 400 
and 500. Information flow paths 360, 370, 460, 470 rep- 
resent the flow of these feedback data. 35 
[0026] The output devices 600, 700, 800 can be 
located remote from or proximal to the originating 
device 100 and each other. Multiple devices of any of 
these three types can exist in a given distributed digital 
image processing system. In any given implementation 40 
of a digital image processing system in accordance with 
the invention, one or more of the above devices 100-800 
may be absent. 

[0027] The distributed digital image processing sys- 
tem 1000 shown in Fig. 2 also includes a measurement 45 
device 900 that can measure image data and various 
other properties of the presentation image appearing on 
the output media or it can measure data about the out- 
put device itself. The measurement device 900 may 
include one or more sensors 901-903 such as colori- so 
metric sensors, optical sensors such as spectrophotom- 
eters as spectral sensors of the color, and/or the optical 
densitometers measuring densities of the printed 
images, scanners, digital cameras, broadband optical 
sensors and the like, capable of detecting image data ss 
values from a presentation image. The three sensors 
901-903 shown in Fig. 2 are merely exemplary. Moreo- 
ver, the raw data generated by the sensors 901-903 



usually will be processed locally within the measure- 
ment device 900 or the sensors themselves (e.g., smart 
sensors). The resulting processed data, as well as the 
data themselves, are referred to generically as the 
"properties determined by the sensors." It should be 
appreciated that any number of sensors considered 
necessary to achieve the expected results of the system 
may be implemented. In a preferred embodiment, the 
measurement device supplies the detected image data 
as well as properties determined by the sensors to the 
distributed digital image processing system 1 000. Alter- 
natively, the measurement device may provide device- 
dependent data (e.g., optical densities for extracting 
tone reproduction curves) to one or more of the devices 
connected to the distributed digital image processing 
system 1000. 

[0028] For example, the measurement device 900 
may include a spectrophotometer to sense the actual 
output spectra of a presentation image on a video dis- 
play or on output media. A spectrophotometer meas- 
ures the color spectral components of a set of local 
areas in the presentation image. Commercially availa- 
ble spectrophotometers are potentially suitable for 
marking device applications. The measurement device 
900 may also include a colorimeter (e g, a RGB sensor). 
A RGB sensor senses red. green and blue values of a 
set of local areas on a presentation image. Alternatively, 
a sensor configured to sense more color values could 
be used. 

[0029] One or more of the sensors 901-903 may 
also be of the type capable of detecting properties, 
characteristics, and the state of the remote output 
devices, for example, memory usage, color rendition 
dictionary parameters, process control system parame- 
ters, available gamut, and the like. A color rendition dic- 
tionary describes a multi-dimensional color transform 
used in the image processing modules to convert, for 
example, red, green, blue (RGB) or L*, a*, b*, continu- 
ous tone values into, for example, cyan, magenta, yel- 
low, black (CMYK) continuous tone values. 
[0030] Further, sensors may reside within an output 
device 600, 700, 800 or separate from the output 
devices whose presentation images the measurement 
device will assess. Links 610, 710. 890 represent the 
data coupling between each respective output device 
600, 700, 800 and the measurement device 900. Each 
sensor detects various characteristics of the presenta- 
tion images appearing on the output media. For exam- 
ple, a spectrophotometer or a colorimeter measures the 
color of a set of local areas as rendered on the output 
device 600, 700. 800. These sensors could be placed 
external to the output device as a retrofit to an existing 
output device. Sensors also could be located internal to 
the output device to be used, for example, to measure 
the toner concentration in a xerographic marking 
engine. Internally placed sensors also can be used to 
measure charge on a photoreceptor or toner mass on 
the unfused media, etc. 



BNSDOCID: <EP 1026893A2J_> 



5 



EP1 020893 A2 



10 



[0031 ] The measurement device 900 processes the 
sensed characteristics of the presentation images and 
of the output devices 600, 700, 800, and provides feed- 
back information to the processing devices 200, 400, 
500, as well as the image originating device 100 of the 
digital information processing system 1000. 
[0032] As shown in Fig. 2, information flow paths 
960, 970, 980, 990 represent the flow of feedback infor- 
mation from the measurement device 900 to the output 
devices 600, 700, 800, the image originating device 
100, and the processing devices 200. 400, 500 of the 
digital image processing system 1000. These paths rep- 
resent the flow of feedback information regarding image 
data or other image properties measured on the output 
media after the conclusion of internal processing by the 
output device 600, 700, 800. For example, path 960 pro- 
vides feedback information from the measurement 
device 900 on the basis of measured image properties 
on the final presentation media, such as the RGB val- 
ues of patches in a test pattern displayed on a display 
screen and density, saturation and background of the 
image. This feedback is used by the video display 600 to 
re-calibrate the video display 600 by resetting display 
elements in the video display 600 on the basis of the 
measured image properties on the final presentation 
media such that the presentation image matches the 
assembled image on the image originating device 100. 
[0033] Information flow path 970 represents the 
flow of feedback information from the measurement 
device 900 to the direct marking device 700. This feed- 
back information results in modification of the marking 
elements of a direct marking device 700, for example, 
drive voltages in an ink-jet device, based on the meas- 
ured properties of the presentation image output on the 
final media as determined by the measurement device 
900. Information flow paths 980-984 indicate the flow of 
feedback information to elements within the indirect 
marking device 800. This feedback information is used 
to modify the marking elements at the imaging station 
810 (e.g., on the receptor or lithographic plate itself or 
the imager (neither one shown)), the development sta- 
tion 820, the transfer station 830, and/or the finishing 
station 840 based on the measured properties of the 
presentation image on the output media 
[0034] Information flow paths 811, 821, 831, 841 
are internal information flow paths within the indirect 
marker 800. These paths 811, 821, 831, 841 provide 
information taken from the Paging station 810, the 
developing station 820, the transfer station 830 and the 
finishing station 840, respectively. (The aforesaid sta- 
tions 810, 820, 830, 840 are hereinafter referred to 
generically as "image development stations.") In certain 
indirect marking technologies (e.g., lithography) there 
may be multiple transfer stations 830 prior to the finish- 
ing station 840, but the considerations given here still 
apply. In order to provide this information, the indirect 
marker is equipped with sensors 801-808 at the stations 
810-840 within the indirect marker 800. The eight sen- 



sors 801-808 shown in Fig. 2 are merely exemplary. It 
should be appreciated that any number of sensors con- 
sidered necessary to achieve the expected results of 
the system may be implemented. These sensors may 

5 include, but are not limited to optical sensors, colorimet- 
ric sensors, RGB sensors, scanners, digital cameras, 
spectrophotometers, pixel counters, electrostatic volt- 
meters, extended toner area coverage sensors 
(ETACS), black toner area coverage sensors (BTACS), 

70 densitometers and microdensitometers, toner mass 
sensors, temperature sensors, infrared densitometers 
(IRDs), conductivity sensors, humidity sensors, weight 
sensors, partial pressure sensors and the like. The opti- 
cal and colorimetric sensors operate the same as those 

7 5 described above with respect to the measurement 
device 900. 

[0035] One of the sensors 80 1 -808 may be an elec- 
trostatic voltmeter or the like that senses the voltage of 
a signal representing an image at any stage of image 

20 development by an indirect marker 800. Another one of 
the sensors may be an optical or mechanical sensor 
that measures one or more of the internal parameters of 
the output device. The properties sensed by the micro- 
densitometers, toner mass sensors and temperature 

25 sensors are self-explanatory. 

[0036] The feedback information provided via paths 
811, 821 describes image properties, such as the elec- 
trical or optical properties of an image, which are used 
to set marking elements in the processing of the imag- 

30 ing station either during or before the writing of the 
image on an imaging member (not shown) and in the 
processing of the developing station. A path 831 pro- 
vides feedback information regarding image properties 
measured after development, but prior to transfer either 

35 to another internal image acquisition medium or to the 
final output medium. In addition, image properties 
measured on the media prior to the final processing of 
the image (e.g., properties of the transferred but 
unfused image in an image-on-image xerographic 

40 device or of the ink image on the intermediate blanket in 
a lithographic press) are fed back via a path 841 to the 
marking elements defining prior states of the image in 
the marking process. This also is the case for multiple 
internal transfers (e.g., in the case of multiple litho- 

45 graphic blankets) prior to the final image setting step 
even though these are not indicated explicitly in Fig. 2. 
These images and/or their properties can be used to set 
the characteristics of the marking elements used in any 
of these prior process steps. Also, feedforward informa- 

so tion from upstream process elements of the indirect 
marker 800 (e.g., pixel count of the image to be output) 
are channeled to the downstream substations of the 
indirect marker 800 in order to inform them of conditions 
affecting their performance. Thus, behavior adjustments 

55 in the affected image development stations may be 
made in order to prepare these affected substations for 
the conditions they will subsequently encounter. 
[0037] In Fig. 2, blocks 999 represent computa- 
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tional elements that perform processing functions to 
convert feedback information from sensor data meas- 
urements into suitable control signals to be used by the 
various processing devices 100, 200, 400, 500, 810, 
820, 830, 840. These structural devices 999 could 5 
share information during processing and may appear as 
one processing device with multiple inputs and multiple 
outputs (not shown). Thus, once a signal is sensed (and 
perhaps processed) by one of the above-described sen- 
sors 901-903, 801-808, the resulting properties deter- 10 
mined by the sensors are fed back or fed forward to 
other stages of the distributed digital image processing 
system 1000. The structural devices 999 convert the 
properties determined by the sensors to meaningfiul 
digital signals that are usable by each respective proc- 75 
ess of the system. The processing devices 200, 400, 
500, 81 0, 820, 830, 840 then make use of the converted 
signals to modify one of the digital representations of 
the assembled image or to adjust the processing ele- 
ments of the processing device to ensure that the pres- 2 o 
entation image matches the image assembled at the 
image originating device. With respect to the image 
originating device 100, the converted feedback signal is 
provided to a customer at the image originating device 
100 so that the customer can manually adjust the 2 s 
assembled image to produce a presentation image that 
appears as desired by the customer. 
[0038] As shown in Fig. 2, information flow paths 
390, 490 represent information feedback loops provid- 
ing information based on the measured characteristics 30 
of the final physical image on the output media. Proces- 
sors 999 process the properties determined by the sen- 
sors coming from the measurement device 900 into a 
form that is usable to the image converter 400 and ren- 
dering device 500. Depending on the detailed imple- 35 
mentation, the processors 999 may not occur separate 
from the converter 400 or the image rendering device 
500. As a result, one or more digitaJ representations of 
the customer image, as defined above, hereafter called 
"digital images", are modified by the image converter 40 
400 and/or the image rendering device 500. The path 
490 results in modifications of the final digital image 
used in the imaging station (e.g., the characteristics of 
halftone patterns generated in the rendering step) 
based on measured properties of the presentation 45 
image on the output media. Path 390 results in the use 
of measured properties of the presentation image on 
the output media to modify intermediate digital images 
or their processing, e.g., the modification of tone repro- 
duction curves used in generating device specific con- 50 
tone images from device independent contone images 
obtained from the image transmission process. 
[0039] Information flow paths 380, 480 represent 
the feedback information provided to the image con- 
verter 400 and the image rendering device 500 by the 55 
image developer 820. the image transfer station 830 
and the image finishing station 840, via paths 822, 832, 
842, respectively. This feedback information is used to 



modify the digital images based on image characteris- 
tics from the intermediate physical images on the recep- 
tor, intermediate media or final output media during 
processing by the indirect marker 800. 
[0040] Information path 190 represents the flow of 
feedback information from measurement device 900 to 
the image originating device 100. Thus, the measured 
properties of the presentation image on the final media 
can be used to permit the originating customer or an 
automatic system to view or sense and/or modify a rep- 
resentation of the image assembled and displayed on 
the image originating device 100 showing how the final 
output image appears once it has been outputted on an 
output device 600, 700, 800. Information path 290 rep- 
resents the flow of the same feedback information to the 
image converter 200. Thus, the measured properties of 
the presentation image can be used by the image con- 
verter to automatically modify the presentation image 
so that the presentation image appearing on the output 
device 600, 700, 800 matches the image appearing on 
the image originating device 100. 
[0041] In operation, an image is assembled on the 
image originating device 100 of the distributed digital 
image processing system 1000. The image may be 
assembled with a graphic or paint application, scanning, 
or the like. The image also may be assembled by spec- 
ifying pointers to reference digital images residing on 
databases elsewhere in the system 1000. At this stage, 
the assembled image usually consists of digital image 
data that is encoded in a device or application specific 
representation of the assembled image. When the orig- 
inating customer decides to send the image to an output 
device to be output as a presentation image, if neces- 
sary, the original assembled image is converted by an 
image converter 200 to a device-independent image 
representation, for example, CIELab or any other such 
known type of digital image data, such as CIELuv and 
YCC. CIELab utilizes a color space in which the values 
L*. a* and b* are plotted to form an orthogonal, 3-dimen- 
sional coordinate system. Equal distances in the space 
approximately represent perceived equal color differ- 
ences. 

[0042] The device independent image representa- 
tion is then transmitted, via the image transmitter 300, to 
a second image converter 400 that converts the device- 
independent digital image representation to an output- 
device-dependent representation of the assembled 
image, for example, *%CMYK contone or any other such 
known type of device-dependent digital image repre- 
sentation. Next, the image rendering device 500 pre- 
pares the device dependent data for output on the 
selected output device 600, 700, 800, for example, by 
converting the CMYK contone image to a halftone 
equivalent. 

[0043] When the presentation image is outputted by 
one or more of the output devices, the sensors 901-903 
of the measurement device 900 perform colorimetric 
sensing, optical sensing, and the like, of the presenta- 



BNSDOCID: <EP 1026893A2_I_> 



7 



EP 1 0263893 A2 



14 



tion image on the final media. Signals generated by the 
sensors 901-903. referred to as properties determined 
by the sensors, representing the measured characteris- 
tics of the presentation image, are then fed back to the 
appropriate output device 600, 700, 800 via paths 960. 
970 and 980, respectively. The output device 600 can 
then automatically re-calibrate itself through use of the 
measured properties of the presentation images pre- 
sented on the video display 600, or the direct and indi- 
rect markers 700, 800 can modify their marking 
elements, for example, drive voltages in an ink-jet 
printer or an imaging station of an indirect marker, 
based on the measured characteristics of the printed 
presentation image. Alternatively, each output device 
can have its own local measurement device so that 
measurements of the presentation image outputted by a 
direct marker 700 are fed back to the display 600 and 
used for its calibration. 

[0044] As previously described, the presentation 
image could be a single or multiple page image and 
may be preceded by a test pattern. Thus, the measure- 
ment device 900 can sense and measure characteris- 
tics of the test pattern and provide feedback information 
to the appropriate output device so that the output 
device can be adjusted and/or re-calibrated to modify 
the presentation image before outputting the portion of 
the presentation image still to be outputted. In the case 
of a large-sized presentation image, test patterns may 
be interspersed throughout. Therefore, the measure- 
ment device can provide feedback information to the 
output devices at appropriate intervals in order to ena- 
ble a control system to prevent drift or degradation dur- 
ing the outputting of the presentation image. In the 
event of a presentation image including multiple copies 
of a large-sized image, a test pattern may precede each 
copy (or any other user-preferred interval). In yet 
another situation, a single page (or other small-sized) 
presentation image may itself be used as the test pat- 
tern, and the measured properties of the presentation 
image can be fed back to the appropriate output device 
for adjustment and/or re-calibration before outputting of 
subsequent presentation images. 
[0045] If an image is output by an indirect marker 
800, the indirect marker 800 entails additional process- 
ing steps before generating the presentation image 
from the rendered representation of the incoming digital 
image. Sensors 801-808 positioned at the imaging sta- 
tion 810, developing station 820, transfer station 830 
and finishing station 840 detect characteristics of the 
image at these various stations of generation of the 
presentation image. The measured properties of the 
image at these various image development stations are 
then fed back and/or fed forward within the indirect 
marker 800 to modify the marking elements at each sta- 
tion within the indirect marker 800. The feedforward 
information could be used to adjust and/or re-calibrate 
for the same portion of the presentation image having 
its properties measured, as well as subsequent portions 



of the presentation image. The feedback information 
would be used to adjust and/or re-calibrate for subse- 
quent portions of the presentation image or subsequent 
presentation images, as discussed above with respect 

5 to the measurement device. 

[0046] Additionally, the measured properties of the 
image at the developing station 820, transfer station 830 
and finishing station 840 are fed back to the second 
image converter 400 and the image rendering device 

w 500 via paths 380 and 480, respectively. The image 
converter 400 and/or the image rendering device 500 
modify the digital representation of the assembled 
image based on the measured properties of the image 
at these various stages of generation of the presenta- 

75 tion image. The feedback information would be used to 
modify subsequent portions of the representation of the 
assembled image or subsequent representations of 
assembled images, as discussed above with respect to 
the measurement device. 

20 [0047] In addition, the signals generated by the 
sensors of the measurement device 900 representing 
the properties of the presentation image on the output 
media are fed back to the image converters 200, 400 
and the image rendering device 500. Thus, the image 

25 converter 400 and/or the image rendering device 500 
can modify the digital representation of th*i assembled 
image based on the measured properties of the presen- 
tation image on the output media. Again, the feedback 
information would be used to modify subsequent por- 

30 tions of the representation of the assembled image or 
subsequent representations of assembled images, as 
discussed above with respect to the measurement 
device. 

[0048] The above-described feedback paths result 
35 in automatic adjustment of one or more digital represen- 
tations of the assembled image at various stages of the 
distributed digital image processing system 1000. Addi- 
tionally, the distributed digital image processing system 
1000 of this invention accommodates manual adjust- 
40 ment of the assembled image by the originating cus- 
tomer to ensure that a particular remote output device 
outputs a presentation image matching a simulated out- 
put of the presentation image, locally accessible to the 
originator. 

45 [0049] In order to effectuate manual adjustment, 
the measurement device 900 provides feedback to the 
image originating device 100 via information flow paths 
990 and 190. The image originating device 100 repro- 
duces the presentation image so that a customer can 

so view a simulated output of the presentation image and 
adjust the image so that the presentation image is out- 
put as desired by the customer. This can be approxi- 
mated by suitably calibrating the display of an image 
originating device 100. To get to the accuracy required 

55 by the graphic arts industry, however, a calibrated prox- 
imal printer 25 or 26 may be used to output the presen- 
tation image on the chosen medium. 
[0050] In addition, the distributed digital image 
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processing system may include the capability of detect- 
ing properties of the assembled image or a representa- 
tion of the assembled image at the image originating 
device 100 and/or the image processing devices 200, 
300, 400, 500, respectively. The system then provides 5 
feedforward information, via flow paths 101-109, to the 
output devices 600, 700, 800 so that the respective out- 
put device can prepare itself for the forthcoming presen- 
tation image, and to the measurement device 900 so 
that the measurement device can accurately process w 
the sensed data to produce the measured image prop- 
erties. In addition, in the embodiment shown in Fig. 2, 
the feed forward information from the image originating 
device 100 and image processing devices 200, 300, 
400 is fed forward to the image rendering device 500, as 75 
indicated by the direction of the arrow of flow path 105 
pointing toward the image rendering device 500. This 
allows the image rendering device 500 to prepare for 
the forthcoming representation of the assembled image. 
[0051] In summary, this invention is concerned with 20 
the use of feedback information from output devices and 
other intermediate processing devices in a distributed 
digital image processing system to inform an originating 
customer, other operator, or an automatic control device 
of the state and properties of an output device, to modify 25 
the digital image at some stage of processing in order to 
accommodate the state and properties of the output 
device, and/or to change the state of the output device 
to produce a presentation image that matches the 
image appearing at the image originating device. 30 
[0052] In one aspect of this invention, the originat- 
ing workstation queries the remote output devices, via a 
central server or set of servers to identify the current 
capabilities and state of the remote output devices. 
Then, printing application software on either the image 35 
originating device or the central server(s) adjusts the 
image so as to create a presentation image that 
matches the image on the image originating device. 
[0053] In another aspect of this invention, real time 
information from the remote output devices, such as 40 
memory, color rendition dictionary parameters, process 
control system parameters, available gamut, and the 
like, is fed back to the image originating device to repre- 
sent how the presentation image will appear on the 
selected output device. Then, the printing application 45 
software could show the originating customer how and 
where the image characteristics would be distorted on 
the remote output device. The customer can then com- 
pensate for the distortion, e.g., by altering the selection 
of colors used in the original electronic image or select- so 
ing a different remote output device. 
[0054] In yet another aspect of this invention, the 
printing application program, residing on either the 
image originating device or central server, can utilize 
the feedback information to adjust the electronic original 55 
during one or more stages of image processing to 
achieve the desired appearance of the presentation 
image on one or more output devices. This approach 



woufd make use of appearance matching models to 
perform the image re-mapping. Any known appearance 
matching model may be used in the implementation of 
this invention, for example, CIECAM, other models 
based on response of the human visual system and the 
like. 

[0055] It should be appreciated that the distributed 
digital image processing system of this invention may 
be used for job-by-job calibration and/or color correction 
of one or more output devices and processing devices. 
It should also be appreciated that the distributed digital 
image processing system of this invention may be used 
to enable a customer to specify custom color configura- 
tions for a particular output device so that the parame- 
ters of the output device will be re-set automatically 
each time that output device is selected to output a 
presentation image. 

[0056] It should be appreciated that the distributed 
digital image processing system of this invention may 
be used for feeding back properties and state informa- 
tion of one or more output devices to a server or image 
originating device in order to enable a customer to 
select an appropriate output device for outputting a 
presentation image. 

[0057] It should also be appreciated that the distrib- 
uted digital image processing system of this invention 
may be used to allow the user to match the gamuts of 
multiple output devices on the system so that all output 
devices distributed on the system output matching color 
appearances. 

[0058] It should also be appreciated that the distrib- 
uted digital image processing system of this invention 
may also be used to provide feedforward information to 
the output devices so that these devices can adjust 
operating parameters so as to optimally render the 
image information. The feedforward information can 
also be used to maximize productivity (e.g., by knowing 
beforehand that extra cleaning will be needed due to 
high are coverage, or if you know the pixel count of the 
image, by preparing the toner sump to contain enough 
toner). 

[0059] Although the processing functions shown in 
Fig. 2 are described as "devices" herein, it should be 
appreciated that this is a logical partitioning and that the 
functions 100-500 attributed to these devices may be 
incorporated into a single physical entity. Moreover, an 
output device having a built-in computer may incorpo- 
rate one or more of the c»^tputting functions 600, 700, 
800 as well as one or more of the processing functions 
200, 300, 400, 500. Further, in any given implementa- 
tion of a distributed digital image processing system 
according to this invention, one or more of these 
processing functions may be absent. 
[0060] While the invention is described wherein the 
processing devices 200-500 are implicitly envisaged as 
being implemented in hardware, the functions of these 
devices may be implemented using software executed 
by a computing device. The image originating device 
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100, the processing devices 200-500, and the output 
devices 600-800 can each be implemented on a gen- 
eral purpose or special purpose computer, a pro- 
grammed microprocessor or microcontroller and 
peripheral integrated circuit elements, an ASIC or other 5 
integrated circuit, a hardware electronic or logic circuit 
such as a discrete element circuit, a programmable 
logic device, or the like. In general, any device capable 
of accomplishing the processing and information flow 
shown in Fig. 2 can be used to implement the distrib- 10 
uted digital image processing system 1 000 functions of 
this invention. 

Claims 

15 

1. A distributed digital image processing system 
(1000), comprising: 

an image originating device (100) on which an 
image is assembled; 20 
a processing device (200-500) linked to the 
image originating device (100) that processes 
and transmits a representation of the assem- 
bled image for outputting; and 
an output device (600-800) linked to the 25 
processing device that outputs the assembled 
image as a presentation image, characterized 
by 

a measurement device (900) linked to the out- 
put device (600-800) and at least one of the 30 
image originating device (1 00) and the 
processing device (200-500), the measure- 
ment device having at least one sensor (901- 
903) that detects properties of the presentation 
image, 35 
wherein the properties detected by the meas- 
urement device are fed back to at least one of 
the image originating device, the processing 
device and the output device. 

40 

2. The system of claim 1 1 wherein the image originat- 
ing device (100), the processing device (200-500) 
and the output device (600-800) are linked together 
by at least one of direct serial connections, a local 
area network, a metropolitan area network, a wide 45 
area network, a network of networks, a satellite 
communication network, an infrared communica- 
tion network and circuit wirings. 

3. The system of claim 1 or claim 2, wherein the so 
processing device (200-500) includes at least one 

of an image converter, an image transmitter and an 
image rendering device, and 

wherein the output device (600-800) is one 
of a video display, a direct marker and an indirect ss 
marker, and 

wherein the at least one sensor (901-903) is 
one of a colorimetric sensor, a spectrophotometer, 



a RGB sensor, a scanner, a digital camera, a densi- 
tometer, a broadband optical sensor, a weight sen- 
sor and a partial pressure sensor. 

4. The system of any of the preceding claims, wherein 
the at least one of the image originating device 
(100), the processing device (200-500) and the out- 
put device (600-900) is adapted to modify the pres- 
entation image in accordance with the fed back 
properties received from the measurement device 
(900), and wherein the output device outputs the 
modified presentation image. 

5. The system of any of the preceding claims, wherein 
the image is assembled through a script, the script 
containing pointers to one or more elements that 
comprise the assembled image, and wherein the 
processing device (200-500) utilizes the script to re- 
assemble a representation of the assembled image 
suitable for outputting. 

6. The system of any of the preceding claims, wherein 
the measurement device (900) further detects prop- 
erties of the output device. 

7. The system according to any of the preceding 
claims, further comprising: 

at least one detector (901-903) positioned at at 
least one of the image originating device (100) 
and the processing device (300-500); and 
an image rendering device that prepares the 
processed representation of the assembled 
image for use by the output device, 
wherein the at least one detector detects prop- 
erties of the assembled image or the represen- 
tation of the assembled image, and 
wherein the properties detected by the at least 
one of the image originating device and the 
image processing device are fed forward for 
use by at least one of the image rendering 
device, the output device and the measure- 
ment device. 

8. The system of any of the preceding claims, further 
comprising: 

a second output device proximaily associated 
with the image originating device (100). 
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processing system (1000) monitors presentation imag- 
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the original image. The originating customer can view 
the image as it appears on a remote output device 
(600-800) and/or adjust the image so that the presenta- 
tion image will match the image appearing on the image 
originating device (100). The system can also automat- 
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with the image originating device. 
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